A step towards understanding why classification helps regression

A number of computer vision deep regression approaches report improved results when adding a classification loss to the regression loss. Here, we explore why this is useful in practice and when it is beneficial. To do so, we start from precisely controlled dataset variations and data samplings and find that the effect of adding a classification loss is the most pronounced for regression with imbalanced data. We explain these empirical findings by formalizing the relation between the balanced and imbalanced regression losses. Finally, we show that our findings hold on two real imbalanced image datasets for depth estimation (NYUD2-DIR), and age estimation (IMDB-WIKI-DIR), and on the problem of imbalanced video progress prediction (Breakfast). Our main takeaway is: for a regression task, if the data sampling is imbalanced, then add a classification loss.Comment: Accepted at ICCV-202

Analysis and compensation for the effect of the catheter position on image intensities in intravascular optical coherence tomography

Cardiovascular Aspects of Radiolog

POST-IVUS: A perceptual organisation-aware selective transformer framework for intravascular ultrasound segmentation

Intravascular ultrasound (IVUS) is recommended in guiding coronary intervention. The segmentation of coronary lumen and external elastic membrane (EEM) borders in IVUS images is a key step, but the manual process is time-consuming and error-prone, and suffers from inter-observer variability. In this paper, we propose a novel perceptual organisation-aware selective transformer framework that can achieve accurate and robust segmentation of the vessel walls in IVUS images. In this framework, temporal context-based feature encoders extract efficient motion features of vessels. Then, a perceptual organisation-aware selective transformer module is proposed to extract accurate boundary information, supervised by a dedicated boundary loss. The obtained EEM and lumen segmentation results will be fused in a temporal constraining and fusion module, to determine the most likely correct boundaries with robustness to morphology. Our proposed methods are extensively evaluated in non-selected IVUS sequences, including normal, bifurcated, and calcified vessels with shadow artifacts. The results show that the proposed methods outperform the state-of-the-art, with a Jaccard measure of 0.92 for lumen and 0.94 for EEM on the IVUS 2011 open challenge dataset. This work has been integrated into a software QCU-CMS2 to automatically segment IVUS images in a user-friendly environment

Plaque burden is associated with minimal intimal coverage following drug-eluting stent implantation in an adult familial hypercholesterolemia swine model

Abstract Safety and efficacy of coronary drug-eluting stents (DES) are often preclinically tested using healthy or minimally diseased swine. These generally show significant fibrotic neointima at follow-up, while in patients, incomplete healing is often observed. The aim of this study was to investigate neointima responses to DES in swine with significant coronary atherosclerosis. Adult familial hypercholesterolemic swine (n = 6) received a high fat diet to develop atherosclerosis. Serial OCT was performed before, directly after, and 28 days after DES implantation (n = 14 stents). Lumen, stent and plaque area, uncovered struts, neointima thickness and neointima type were analyzed for each frame and averaged per stent. Histology was performed to show differences in coronary atherosclerosis. A range of plaque size and severity was found, from healthy segments to lipid-rich plaques. Accordingly, neointima responses ranged from uncovered struts, to minimal neointima, to fibrotic neointima. Lower plaque burden resulted in a fibrotic neointima at follow-up, reminiscent of minimally diseased swine coronary models. In contrast, higher plaque burden resulted in minimal neointima and more uncovered struts at follow-up, similarly to patients’ responses. The presence of lipid-rich plaques resulted in more uncovered struts, which underscores the importance of advanced disease when performing safety and efficacy testing of DES

Interactive Visual Exploration of 3D Mass Spectrometry Imaging Data Using Hierarchical Stochastic Neighbor Embedding Reveals Spatiomolecular Structures at Full Data Resolution

Technological advances in mass spectrometry imaging (MSI) have contributed to growing interest in 3D MSI. However, the large size of 3D MSI data sets has made their efficient analysis and visualization and the identification of informative molecular patterns computationally challenging. Hierarchical stochastic neighbor embedding (HSNE), a nonlinear dimensionality reduction technique that aims at finding hierarchical and multiscale representations of large data sets, is a recent development that enables the analysis of millions of data points, with manageable time and memory complexities. We demonstrate that HSNE can be used to analyze large 3D MSI data sets at full mass spectral and spatial resolution. To benchmark the technique as well as demonstrate its broad applicability, we have analyzed a number of publicly available 3D MSI data sets, recorded from various biological systems and spanning different mass-spectrometry ionization techniques. We demonstrate that HSNE is able to rapidly identify regions of interest within these large high-dimensionality data sets as well as aid the identification of molecular ions that characterize these regions of interest; furthermore, through clearly separating measurement artifacts, the HSNE analysis exhibits a degree of robustness to measurement batch effects, spatially correlated noise, and mass spectral misalignment

An optical coherence tomography and endothelial shear stress study of a novel bioresorbable bypass graft

Endothelial shear stress (ESS) plays a key role in the clinical outcomes in native and stented segments; however, their implications in bypass grafts and especially in a synthetic biorestorative coronary artery bypass graft are yet unclear. This report aims to examine the interplay between ESS and the morphological alterations of a biorestorative coronary bypass graft in an animal model. Computational fluid dynamics (CFD) simulation derived from the fusion of angiography and optical coherence tomography (OCT) imaging was used to reconstruct data on the luminal anatomy of a bioresorbable coronary bypass graft with an endoluminal "flap" identified during OCT acquisition. The "flap" compromised the smooth lumen surface and considerably disturbed the local flow, leading to abnormally low ESS and high oscillatory shear stress (OSI) in the vicinity of the "flap". In the presence of the catheter, the flow is more stable (median OSI 0.02384 versus 0.02635, p < 0.0001; maximum OSI 0.4612 versus 0.4837). Conversely, OSI increased as the catheter was withdrawn which can potentially cause back-and-forth motions of the "flap", triggering tissue fatigue failure. CFD analysis in this report provided sophisticated physiological information that complements the anatomic assessment from imaging enabling a complete understanding of biorestorative graft pathophysiology

Characterization and Evaluation of the Artemis Camera for Fluorescence-Guided Cancer Surgery

Purpose: Near-infrared (NIR) fluorescence imaging can provide the surgeon with real-time visualization of, e.g., tumor margins and lymph nodes. We describe and evaluate the Artemis, a novel, handheld NIR fluorescence camera.Procedures: We evaluated minimal detectable cell numbers (FaDu-luc2, 7D12-IRDye 800CW), preclinical intraoperative detection of sentinel lymph nodes (SLN) using indocyanine green (ICG), and of orthotopic tongue tumors using 7D12-800CW. Results were compared with the Pearl imager. Clinically, three patients with liver metastases were imaged using ICG.Results: Minimum detectable cell counts for Artemis and Pearl were 2 × 105 and 4 × 104 cells, respectively. In vivo, seven SLNs were detected in four mice with both cameras. Orthotopic OSC-19-luc2-cGFP tongue tumors were clearly identifiable, and a minimum FaDu-luc2 tumor size of 1 mm3 could be identified. Six human malignant lesions were identified during three liver surgery procedures.Conclusions: Based on this study, the Artemis system has demonstrated its utility in fluorescence-guided cancer surgery

Foreword

Extraction of the aorto-femoral vessel trajectory is important to utilize computed tomography angiography (CTA) in an integrated workflow of the image-guided work-up prior to trans-catheter aortic valve replacement (TAVR). The aim of this study was to develop a new, fully-automated technique for the extraction of the entire arterial access route from the femoral artery to the aortic root. An automatic vessel tracking algorithm was first used to find the centerline that connected the femoral accessing points and the aortic root. Subsequently, a deformable 3D-model fitting method was used to delineate the lumen boundary of the vascular trajectory in the whole-body CTA